Update LAION-example and default value of scheduled_tasks#1092
Update LAION-example and default value of scheduled_tasks#1092SvenDS9 wants to merge 2 commits intometa-pytorch:mainfrom
scheduled_tasks#1092Conversation
facebook-github-bot
added
the
CLA Signed
|
128 was still to low - at least with a timeout of 5 seconds. With this new value I am mostly limited by my internet connection. I have also compared the speed to |
| input_col=None, | ||
| output_col=None, | ||
| scheduled_tasks: int = 128, | ||
| scheduled_tasks: int = 500, |
There was a problem hiding this comment.
TBH, this highly depends on the size of request and response.
If we are loading video files, such a high number might not provide the best perf
There was a problem hiding this comment.
Hmm scheduled_tasks negatively affects performance if it is too low, yes. Higher values will increase memory usage (e.g. if the current video takes a lot longer to download than the next few which are then prefetched and stored in memory) but in this case one is limited by internet connection speed anyway. Why should it negatively affect performance (throughput) if it's too high?
3 participants
Changes